Number parsing at a gigabyte per second

نویسندگان

چکیده

With disks and networks providing gigabytes per second, parsing decimal numbers from strings becomes a bottleneck. We consider the problem of to nearest binary floating-point value. The general requires variable-precision arithmetic. However, we need at most 17 digits represent 64-bit standard (IEEE 754). Thus, can significand with single word. By combining precomputed tables, compute number using as few one or two multiplications. Our implementation be several times faster than conventional functions present in C libraries on modern systems (Intel, AMD, ARM, POWER9). work is available open source software used by major such Apache Arrow Yandex ClickHouse. Go library has adopted version our approach.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Parallel photonic information processing at gigabyte per second data rates using transient states

The increasing demands on information processing require novel computational concepts and true parallelism. Nevertheless, hardware realizations of unconventional computing approaches never exceeded a marginal existence. While the application of optics in super-computing receives reawakened interest, new concepts, partly neuro-inspired, are being considered and developed. Here we experimentally ...

متن کامل

Performance Considerations for Gigabyte per Second Transcontinental Disk-to-Disk File Transfers

Moving data from CERN to Pasadena at a gigabyte per second using the next generation Internet requires good networking and good disk IO. Ten Gbps Ethernet and OC192 links are in place, so now it is simply a matter of programming. This report describes our preliminary work and measurements in configuring the disk subsystem for this effort. Using 24 SATA disks at each endpoint we are able to loca...

متن کامل

WiGig and IEEE 802.11ad - For multi-gigabyte-per-second WPAN and WLAN

The Wireless Gigabit Alliance (WiGig) and IEEE 802.11ad are developing a multigigabit wireless personal and local area network (WPAN/WLAN) specification in the 60 GHz millimeter wave band. Chipset manufacturers, original equipment manufacturers (OEMs), and telecom companies are also assisting in this development. 60 GHz millimeter wave transmission will scale the speed of WLANs and WPANs to 6.7...

متن کامل

Modified Six-Minute Walk Test: Number of Steps per Second

The 6-min walk test (6MWT) has been used to examine subjective dyspnea, predict mortality and measure clinical outcomes in studies of patients with chronic pulmonary or heart disease. Although the 6MWT is useful to assess the general ability to perform daily physical activity, it is difficult to evaluate time-dependent responses. To improve the 6MWT, we devised a new index, which is the number ...

متن کامل

Broadband coherent Raman spectroscopy running at 24,000 spectra per second

We present a Fourier-transform coherent anti-Stokes Raman scattering (FT-CARS) spectroscopy technique that achieves broadband CARS measurements at an ultrahigh scan rate of more than 20,000 spectra/s - more than 20 times higher than that of previous broadband coherent Raman scattering spectroscopy techniques. This is made possible by an integration of a FT-CARS system and a rapid-scanning retro...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Software - Practice and Experience

سال: 2021

ISSN: ['0038-0644', '1097-024X']

DOI: https://doi.org/10.1002/spe.2984